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Abstract 

A general approach for Bayesian filtering of multi-object systems is 
studied, with particular emphasis on the model where each object gener- 
ates observations independently of other objects. The approach is based 
on variational calculus applied to generating functionals, using the general 
version of Faa di Bruno's formula for Gateaux differentials. This result 
enables us to determine some general formulae for the updated generating 
functional after the application of a multi-object analogue of Bayes' rule. 

1 Introduction 

Many control applications are concerned with the estimating the state of dynam- 
ical systems that have uncertainty in their dynamical and observation charac- 
teristics. Stochastic filtering methods for discrete-time systems are of particular 
importance and have widespread applicability. The extension of stochastic filter- 
ing to multi-object systems was developed for discrete-time systems as a means 
of identifying and tracking an unknown number of objects in aerospace applica- 
tions [T] . This was based on the Chapman-Kolmogorov equation for stochastic 
population processes proposed by Moyal [5] , and the derivation of Bayes' rule for 
point processes by Mahler [1]. The mathematics required is based on the the- 
ory of generating functionals |3] for describing the evolution of the multi-object 
system, which is closely related to the methods used in quantum field theory [4] 
for describing the evolution of many- particle systems [5]. The development of 
stochastic filtering concepts for multi-object systems has received considerable 
attention in the signal processing literature in the last decade for multi-target 
tracking applications [i H HI [TJ H [10] . 

This paper describes a general functional form for the Bayesian estimator 
when each object generates observations independently of other objects using 
the higher-order chain rule for Gateaux differentials [TT]. This result gener- 
alises the approach for Bayesian estimation of multi-object systems proposed 
by Mahler [1] [9] , that has been developed for applications in multi-target track- 
ing and sensor control [l2l HSl [14] . 
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The paper is structured as follows. In the next section, the necessary back- 
ground on generating functionals and Gateaux differentials is provided. In sec- 
tion 3, point processes and conditional point processes are described with gen- 
erating functionals. In section 4, the Chapman-Kolmogorov equation is briefly 
described to place the work in the context of Bayesian filtering. The main results 
of the paper are in section 5 which describes general Bayesian estimation for 
multi-object systems and derives the general formula for the case where objects 
generate observations independently of other objects. 

2 Generating functionals 

The theory of functionals for describing the state of systems of with variable 
numbers of objects was developed by Volterra through the concept of generat- 
ing functionals [3|. In quantum physics, this idea was adopted by Fock [15] and 
Berezin |16) for describing an indefinite number of particles in the method of 
second quantization. In probability theory, Moyal described stochastic popula- 
tion processes with the probability generating functional (p.g.fl.) [5], which can 
be viewed as a generalisation of the probability generating function (p.g.f.) to 
uniquely characterise a point process. Factorial moment densities and Janossy 
densities of the point process are found by finding variations of the p.g.fl. with 
Gateaux differentials [T7|. 

This section discusses generating functionals as a means of describing sys- 
tems with a variable number of objects. Gateaux differentials are discussed as a 
means of detemining their constituent functions. The higher-order chain rule is 
introduced to determine the differentials of composite functionals [11] . Finally, 
the scalar product in Fock space [15] is used to operate on two functionals. 

Definition: Gateaux diffterential 

A functional can be viewed as a function that takes functions as its argument. 
A Gateaux differential [TH p71-74], of a functional ^{ip) with increment ^, can 
be defined with 



The rt*'*-order differential (or variation), which is defined by recursively, is de- 
noted S"'^{ip,(,i, . . . ,Cn)- When this is evaluated at the Dirac delta functions 
= ^xi, ■■■,^n = Sx„, centred at xi, . . . ,a:„, we write this as 



Definition: generating functional 

Every functional ^'(V') continuous in the field of continuous functions can be 
approximated by a generating functional 



= lim - {^{i: + - ^W) • 



(1) 



(5"^'(V';5^(xi)...5V'(a;„)). 



(2) 



*w = Co + ^^ / Y[dx^i;{x^) 



IV. \ J 

n—1 \ i—1 




(3) 
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where the functions Cn{xi, ■ ■ ■ , Xn) are continuous functions independent of the 
variable ip{x) that are symmetric in their arguments. For compactness of nota- 
tion, we write this as 

^^'^^=fl^, i I \{dx^^{Xi)\Cn{Xl,...,Xn)■ (4) 

n=0 ^' V i=l I 

This result, due to Volterra ^ p20], generalises Weierstrass' theorem on contin- 
uous functions represented by polynomials, to the case of an infinite number of 
variables. This series is convergent if I'l/'l^)! < for some radius of convergence 
P- 

The functions Cn(2^ij ■ • ■ i 2;„) [3], can be recovered by finding the Gateaux dif- 
ferentials with 

(5"^'(?/';(5V'(xi)...5V'(x„))|^^o = C,^(xx,...,xn). (5) 
Lemma 1: Faa di Bruno's formula 

Let n be the set of all partitions of variables 771, . . . ,?]„, and vr G 11 denote 
a single partition that has constituent blocks cj G tt of size |a;| consisting of 
constituent elements Ctt.lj.i, • ■ • , C^-k,lo,\lo\ G {jyij ■ ■ ■ ■, '^n\■ The n*''-order variation 
of composition jog with increments ryi , . . . , 77„ is given by 

-5" ((/ ° 9) (y) ; 771, . . . , 77„) = E (5(y); e^,i(2/). ■ • • . , (6) 

where ^7r,i.j(y) is the variation of order |a;| with increments Ctt.lj,!, • ■ • , Ctt.wJwI: 
i.e. 

C.,c.(2/) = ^^i"i^5(y;C.,.,i,---,C.,.,i.i)- (7) 

Proof 

See Clark (TT]. 

Lemma 2: Leibniz' rule for functionals 

Leibniz' rule for functional derivatives the differentials of the product f{y)g{y) 
with increments S = {771, . . . , ?7„} is 

^" {f{y)9{y);vi,---,Vn) ^ ^'*'/(y;'?^i'---''/'i*i)'5'"'"'*'5(2/;Ci,---,^iH|-i<E.|) , 

(8) 

where the summation is over all subsets $ of the increments, and $ = {0i, . . . , 

S-$ = Ul,...,f|H|-|*|}. 

Proof 

See Mahler [19l p389]. 

We recall a result from Clark [11 , which shall be used to determine the first- 
order factorial moment density of a point process in section 3. 
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Lemma 3 

Let us consider the can be used for the n*'' variation of composite f{g{y)) with 
increments ^i{y), ...,^„{y), i.e. 

<5("V(ff(2/);6(y),---,en(y)) (9) 

Then the differential of this becomes 

S (<5(")/ (giy); Uv), ■ • ■ , Uv)) ; v) = '5("+^V (giy); 6(2/), ■ • ■ , Uy),S'9 {y; v)) 

(10) 

n 

+ E '^'"V ei(y), • ■ • , suy; v), • ■ • , Uv)) ■ 



Proof 

See Clark [TT]. 

Definition: scalar product 

Let us suppose that we have two functionals ^i('0) and ^2{'^), represented by 
generating functionals, so that 

(11) 

„=o"- V"' i=l I 

*2(V') ^f^^i f f[dx^^P{xi)] ij2,n{xi,---,Xn), (12) 

where ?/'i^„(xi, . . . ,a;„) and ■0i,„(a;i, . . . ,Xn) are real-valued. We can define a 
scalar product of ^'i('0) and ^'2('0) is with [IJ pl64] 



n=0 V"^ i=l / 



)V'2.n(2:i, • • ■ ,a;„). (13) 



3 Probability generating functionals 

Following Moyal [5], define the probability generating functional (p.g.fl.) with 
Gx(V') = E^( [f[dx.ii}ixi)]pn{xi,.-.,Xn): (14) 

where p„(a;i, . . . , a;„) > are Janossy densities and G'x(V') = 1- We refer to 
the sequence of functions Pn(xi, . . . ,a;„) as a multi-object probability density. 
The p.g.fl. is commonly used in point process theory to characterise point pat- 
terns [20] ■ The Janossy densities Pn{xi, . . . ,Xn) and factorial moment densities 
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Mn{xi, . . . ,Xn) can be recovered from the p.g.fl. by finding its variations [31 [2], 



I.e. 



P„{xi, ...,Xn) = S'^Gxiip;S'ip{xi) . ■ ■5il;{xn))\^^o ' (15) 
M^{xi,...,xn) = S''Gx{t,S^{xi)...S^{xn))\^^^. (16) 

Definition: conditional probability generating functional 

Let us define a generating functional Gz\x{'fp\'']^ 0) of the form 



Gz|x(V'l^,'^) 
where 



\ [ tl^xM^iM^j)] Hz\x{i'\xi,...,x„) (17) 



CO \ ( f ^ 

Hz\xii^\xi,...,Xn) =Y.—A l[' 

m=0 ■ V"^ 1=1 



/ 

(18) 

and for any n>0 and S = {xi, . . . ,x„}, p„[„(zi, . . . , Zm\xi, . . . ,a;„) > 0, 

X! I / Il'^^M • • • '^"iNl' • • -^^n) = 1- (19) 

m=0 ' V"^ i=l / 

The sequence p,„|„(2:i, . . . , Zm\xi, . . . , Xn) defines a conditional multi-object prob- 
ability density, and Gz\x{'4'\Vi4') defines a conditional probability generating 
functional. 

Theorem 1 

Let us define 

9fc|m(a;i,...,a;fc|zi,...,z„i) = (20) 

Pm|fc(2^1, ■ • • , Zrn\xi, . . . ,Xk)pk{xi,. . . 
T,n=0 7d (/ n"=l f^yj) Pm|«(zi, ■ • ■ , ^^mlyi, • ■ • , 2/n)Pn(|/l, • ■ • , ^n) 

Then the sequence of functions qklmi^ii ■ ■ ■ ^ Xk\zi, . . . , Zm) is a conditional multi- 
object probability density. 

Proof 

For any set Z = {zi, . . . , z„i}, we can evaluate the infinite sum 

(/ n^yj j <lk\m{yi,---,yk\zi,...,z^). (21) 
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Substituting this into equation (PT|) . we get 

Efclo F (/nLl fiyj) Pm\kizi, ■ . ■,Z^\xi, . . .,Xk)pk{xi,...,Xk) 

— A { = 1. (22) 

Er=0 (/ nj=l dyjj Pm\n{zi, ...,Z^\yi,..., yn)Pn{yi, ■■■,yn) 

Thus the sequence of functions Qklmi.'^i i ■ • • ;*^fc|-^i7 • ■ • ? 

) defines a conditional 

multi-object probability density. 
Corollary 

The conditional multi-object density function defined with sequence of functions 
9fe|m(yii • • ■ J yk\zi, . . . , Zm) iu Theorem 1 is a multi-object analogue of Bayes' 
rule. Thus, if we have a set of measurements Z = {zi, . . . , Zm}, and multi-object 
prior probability density, we can determine a conditional posterior multi-object 
probability density. 
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4 The Chapman-Kolmogorov equation 

For a single-object system, the Chapman-Kolmogorov equation propagates a 
posterior density pk{x') in state x' at time-step k, with a Markov transition 
/m (a; I a;') to time-step fc-|-l to give predicted density pj;_|_iH;(a;) = / fMix\x')pk{x')dx'. 
In multi-object systems, we need to consider all joint densities, which motivates 
the use of probability generating functionals. Let us define a conditional prob- 
ability generating functional Gm{4'\v) that describes the Markov transition of 
the multi-object system, 

GMim = (23) 

^^'^\^\ \ I X\_dXi1p{Xi)\ j I ']\dyjri[yj)\pM,n\m,{xi,...,Xn\yi,---,yrn), 

^)iere pM,n\m{xi, • ■ • , a;n|yi, • ■ • , J/m) is the probability of transition to the multi- 
object state xi, . . . ^Xn at the next time-step from multi-object state j/i, . . . , ym 
at the current time-step. Then, using the scalar product for functionals in Fock 
space, the predicted p.g.fl. [H [1] is given by 

Gk+i\M) = {GM{M-).Gk), (24) 

where Gk is the p.g.fl. for the posterior probability density at time-step k. 
This follows straightforwardly from the definition of the scalar product. The 
Janossy densities and factorial moment densities can be determined via Gateaux 
differentials. Since we are primarily focussed on Bayesian estimation, we do not 
provide further details. 
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5 Bayesian estimation 

For a single-object system, Bayes' rule updates a prior p{x) with measurement 
z using likelihood g{z\x) using the formula p(a;|z) — p(x)g{z\x) / J p{y)g{z\y)dy. 
This section develops Bayesian estimation for multi-object systems based on 
Mahler's approach for determining the posterior p.g.fl. based on a set of mea- 
surements [T]. Section 3.1 derives the general multi-object Bayesian estimator. 
Section 3.2 describes the Bayesian estimator where each object generates ob- 
servations independently of other objects and derives the general generating 
functional form. 

5.1 General multi-object Bayesian estimator 

The probability generating functional and conditional probability generating 
functional are defined. Theorem 1 derives a multi-object analogue of Bayes' rule. 
Lemma 4 provides a means of determining the updated multi-object probability 
density via generating functionals. This was originally shown by Mahler [I] 
using a bivariate functional 



Lemma 4 

Consider the scalar product (Gz|x(V-'h: ^x) of the form (fTT]) and prior p.g.fl. 
Gx, and let us define the conditional generating functional 



F[^,r,] = {GzixmVr),Gx). 



(25) 



The sequence of functions qk\mixi, . . . , Xk\zi, . 
ing the variations as follows 

Qklmixi, ■ ■ ■,Xn\zi, . . . = S'' G x\z{v\zi , 



Gx\z{'n\zi, ■ • • , 




z„i\5f]{xi) . ..5i]{xk) 



ri=0 ' 



(27) 



Proof 



The scalar product evaluates to be 



{Gz\xii'\v,-),Gx)^Y.^[ / Ild^M^^) 



n=0 j=l 




Hz\x{i'\xi,. ■ .,Xn)pn{xi, Xn)- 



(28) 



Finding the variations of this leads to 



^™ {{Gz\xmv, ■), Gx);6^izi) . . . S^{z^)) 



(29) 
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Hence, if we subsequently find the variations of Gxizivl^ij • • • i ^m), we get 
S''Gx\z{v\zi, z^;5t]{xi) . . . Sr]{xk))\^^^ (30) 

_ ^"+" {{Gzixi^lv, ■),Gx); Sflixi) . . . 5f^{xk),S^j{zi) . . . 5i^{z^))\^^^^^^^^ 
^ S"' {{Gz\x Gx); S^iz,) . . . 1^^^ 

_ Pni\k{zi, ■ ■ ■,Zm\xi, ■ ■ .,Xk)pk{xi,.. ■ , Xfc) 

X/n=0 n\ 11^ = 1 ^-^j^ Pm\n{zi , ■ • ■ , Zm\x\ , • ■ • , Xn)Pn ■ ■ ■ j ^n) 

= qk\m{Xl, . . .,Xk\zi, . . .,Zm)- 

Corollary 

The conditional generating functional • ■ • ; Zm) defines the probability 

generating functional for determining the Janossy densities qk\m{xi, . . . , Xfcjzi, . . . , ^m)- 
We refer to Gx\z{'n\^ii ■ ■ ■ , Zm) as the p.g.fl. Bayes update. 

In the next section we use the general p.g.fl. Bayes update to determined the 
p.g.fl. for the case where each object generates independently of other objects. 

5.2 Independently generated observations 

This section considers the scenario where the p.g.fl. likelihood defined in (|18p 
becomes 

n 

Hzixii^lxi, . . . ,X„) = ]^G'z|2;(V'ki), (31) 

i=l 

where 

Gzixi-fPlx) ^^—^j Wdzi^l){zi)r„^\-i^{zi,...,Zm\x), (32) 

m=0 ■ •' i=l 

and r^\i{zi, . . . , Zm\x) is a Janossy density conditioned on a single object x. 
Moyal defined this named this process a multiplicative population process [2] and 
showed that it represents the scenario where objects generated measurements 
independently of other objects. In this section we provide the general formula 
for this model in terms of its p.g.fl.. Lemma 5 describes the scalar product from 
section 3.1, which is used in Theorem 2 to derive the generating functional form 
of Bayes' rule. This is of the form of a composite of functionals, which enables 
us to use the higher-order chain for Gateaux differentials [11]. The resulting 
formula is demonstrated with the example of a Poisson point process. The 
general first-order moment is then derived for this model. 
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Lemma 5 

The scalar product defined in (IT7| for this model becomes 

{Gz\x{^Av,-),Gx) = Gx {vGz\A^\-)) ■ (33) 

Proof 

The conditional probability generating functional GzixWv^ 4>) in equation (|17p 
becomes 

Gz\x{.ij\-n,4>) ^^—^ I '[\dxjri{xj)(j){xj)Gz\x{'il^\xj). (34) 
Hence the scalar product becomes 

(Gz|x(V'|'7, O^Gx) = ^ ^ I I W_dxjr]{xj)Gz\x{Mxj)\pn{xi,.-.,Xn) 

(35) 

= Gx {vGz\M\-)). 

as required. 

For compactness of notation in Theorem 2, let us introduce the notation Po{x) = 
'ra\i{x), P\z\{Z\x) = r„|i(2i, . . .,Zm\x), where Z = {zi, . . . 

Theorem 2 

Let us suppose that 11 is the set of all partitions of the measurement set Z . The 
general p.g.fl. Bayes update for this model becomes 

E.Gn'^'^'Gx (ryPo;r?P|z,.,|(^.,i|-), • ■ ■ ,vP\z^,^,\{Z,m\-)) 

Gx\z{v\zi, ■ • • ,^m) = 7 X , 

E.en^l'^lG'x (Po;/iz,,,|(^.,i|-),---,^|z„,,,||(^-^l-ll-)) 

(36) 

where for each partition tt, Z is the disjoint union of subsets Zt^j C Z. 
Proof 

The m*''-order variation of the scalar product {Gzixii^lV: ')tGx) simplifies to 
finding the TO*''-order variation of composite Gx {vG z\x{i'Vy) , so that 

{{Gz\x{^\v. •), Gx); '5r/(zi), . . . , <5,7(z„0) = '5™ (Gx {r^Gz\x{^\-)) ; <5rKzi), . . . , Jr;(z„0) 

(37) 

Using the higher-order chain rule, we find that this is equal to 

^ 5\^\Gx {iiGz\x{'^\-Y ■ • • , ('/'I-)) , (38) 
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where the sum is over all partitions of measurement set The increments 
a,r,w(V'l') sre found with the variations of Gz\xi'>P\')j where 

a^A-^l-) = S^'^^Gzix (V-l-; . . . , C..c.>|) , (39) 

and each C^.i^A G {'5f](^i), • ■ • ,Sr]{zm)} is counted once for each partition tt of 
the increments. Then setting ip = 0, we have 

Gz\AO\x)^Po{x), (40) 
(0|x)=P|z„,^,|( )• (41) 

Substituting this into ([55)) and (|26l) yields the result. 
Corollary 

The result given above shows that the p.g.fl. Bayes update can be described in 
terms of variations of the prior p.g.fl... Since the p.g.fl. uniquely characterises a 
point process, it suffices to present the updated point processes in terms of their 
p.g.fl.. This provides a general formula for the model introduced by Mahler [Hin]. 

Example: Poisson point process 

This parameterisation was considered in the Probability Hypothesis Density 
(PHD) filter proposed by Mahler [T]. Let us suppose that we have a Poisson 
point process with intensity /i(a;). The p.g.fi. becomes [211 pl67] 

Gx(?7)-exp(/i[77-l]) (42) 

where we adopt the functional notation ^[rj\ = J fi{x)'r]{x)dx. Then the p.g.fl. 
Bayes update is 

Gx\z{v\zi, ■ • ■ , z„,) = cxp [{i] - l)Po]) — — r^i — -• (43) 

Proof 

The A:*''-order variation of the Poisson p.g.f.l. with increments rji, . . . ,7]^ is 

fe 

S^Gx (?y; ?7i, ■ • ■ , m) = exp {fi [77 - l]) a* h] ■ (44) 

1=1 

The result follows by substitution into equation (l36l) . 

The first-order factorial moment density, known as the intensity function in the 
point process literature, is typically used in signal processing applications [T], 
which can be found by further Gateaux differentiation. We now use Theorem 2 
to find the first-order factorial moment density in Theorem 3. 
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Theorem 3 

The general form of the first-order factorial moment density Mi{x) is given by 



Miix) 



(45) 



E.en Ell'i (Po; Piz^jZ,,i\-), P\z^^^\{Z^M^ ■ • • > ,,,1 I') 



where the z*'' increment in the second summation is evaluated at P\z^ i|(-^ir,i|a^)- 
Proof 

Using the product rule for Gateaux differentials from section 2, we get 



5Gx\z{.'n;£.\zi,---,z„i) 



(46) 



E.enE!lU''''Gx (7?Po;r;P|2„,,|(Z^,i|-),...,CP|z„.|(^^,.|-),---,^/^z„i„|(^.>||-) 
E.en'^l^'G^ (Po;P|iJ„,|(^.,i|-),---,^|z.,„il(^->l|-)) 
where ^ replaces 77 in the z"* increment, since when g{rj) = yyP, 

^.9('?;0-^^, (47) 

which follows directly from the definition of the Gateaux differential. Letting 
77 — 7> 1 and ^ = (5a;, we get the desired result. 

Corollary 

Theorem 3 allows us to determine the updated intensity function of a point 
process after the application of the multi-object analogue of Bayes' rule. This 
provides a general result for multi-object filters where it assumed that objects 
generate measurements independently of each other, introduced by Mahler [I]. 

Example: Poisson point process 

Following the Poisson point process described earlier, the first-order factorial 
moment density Mi (x) is given by 



E.enn!l'iM (p^{^)+Y};ii 



^1 



E.ennll'iM[^|z„.|(^..|-)] 



(48) 



11 



Proof 

The result is an application of Theorem 3 that follows by substitution of (I44p 
into equation 

5.3 Independently generated measurements and uncorre- 
lated observations 

This section extends the scenario considered in the previous section by including 
observations uncorrected with objects, so that 

n 

Hz\x{^\xi,...,Xn) = G^{'^lJ)Y[Gz\xi^\x^), (49) 

1=1 

where the generating functional G^^'tp) is uncorrelated with the objects. This is 
the scenario typically used in target tracking applications [U [S] . In this section 
we provide the general formula for this model in terms of its p.g.fl.. Lemma 
6 describes the scalar product from section 3.1, which is used in Theorem 2 
to derive the generating functional form of Bayes' rule. This is of the form 
of a composite of functionals, which enables us to use the higher-order chain 
for Gateaux differentials [TT]. The resulting formula is demonstrated with the 
example of a Poisson point process. The general first-order moment is then 
derived for this model. 

Lemma 6 

Let us consider conditional probability generating functional in equation (|32p 
and 

GkW = X! ~! ( / n^^»'^(^*) ) Pm\oizi,---,Zm) (50) 
m=0 V"^ i=l / 

Then the scalar product {Gzixii'lVj ')tGx) becomes 

{Gz\x{i^\v, ■),Gx) = G,(V)Gjf {vGz\M)) ■ (51) 

Proof 

Since the G^lip) functionals and Gx {vGz\x{'^A')) ^^'6, by definition, indepen- 
dent we can use the multiplicative property of Moyal [2] , which states that the 
superposition of two independent point processes can be determined through 
the multiplication of their p.g.fi.s. 

Theorem 4 

The general p.g.fl. Bayes update for this model becomes Let us write Prn\o{zi , • . ■ , z^) = 
Pk(Z), where Z = {zi, . . . , Zm)- 

Gx\z{v\zi,---,Zm) = (52) 
EvKcz ^« (Z \ W) E.en„. ^^^^^^Gx {Pz\. (0|-) ; Pz\. (^..ilO ,---,Pz\. lO) ' 
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where the left summation is over all subsets W of measurement set Z, and the 

inner summation is over all partitions of W. 

Proof 

From Leibniz' rule and equation (pS)) . the fc*''-order variation of product Gk.{iIj)Gx {vGz 
with respect to ^p and increments $ — {r/i, ...,77^} becomes 

(53) 

where a^j is defined in equation 1391 In a similar manner to Theorem 2, when 
we substitute into the general p.g.fl. in equation (|26p we get the required result. 

Corollary 

The general form of the first-order factorial moment density follows from The- 
orems 3 and 4. We omit this result for brevity. 

6 Discussion 

This paper provides a general means of Bayesian estimation for multi-object 
systems where each object generates measurements independently. Using the 
higher-order chain rule for Gateaux differentials, a general functional form for 
Bayesian estimation. In a forthcoming paper, this result will be applied to a 
range of point process models for statistical signal processing applications. 
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